🕷️️ Job Radar • SCRAPING

freelancer.com 🟠 2026-05-07

🔹 Southeast Asia Daily AQI Dataset
👤 Client: 🇮🇳 Badarpur, India Member since 2026-03-24
💰 Price: $86 Average bid
🚩 Problem: Gather daily air-quality data for India, Indonesia, and the Philippines from 2019 to 2025.
📦 Existing: Not specified

Specifications:

[Target] Air quality indicators (PM2.5, PM10, NO₂, SO₂) and meteorological variables (temperature, humidity, wind speed, rainfall)
[Method] Direct data collection from national or provincial government portals and monitoring stations
[UI/UX] N/A
[Stack] Python/R for scraping and cleaning; CSV for storage
[Security] Ensure data privacy and compliance with relevant regulations
[Format] CSV files per country, including date, station ID/name, latitude, longitude, PM2.5, PM10, NO₂, SO₂, temperature, humidity, wind speed, rainfall, AQI

Workflow:

Identify official government portals and monitoring stations for India, Indonesia, and the Philippines.
Develop Python/R scripts to scrape daily air-quality data (PM2.5, PM10, NO₂, SO₂) and meteorological variables from identified sources.
Clean scraped data ensuring consistency in units (µg/m³ for pollutants, °C, %, m/s, mm).
Map station locations using latitude and longitude coordinates.
Ensure daily continuity: ≥90% of days present per variable per station over the full time span.
Create unique keys based on date and station ID/name to avoid duplicate rows.
Generate a README file detailing source URLs, retrieval methods, units, conversion factors, and missing value handling.